A multimodal corpus of simulated consultations between a patient and multiple healthcare professionals

Abstract Language resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related recording real medical consultations. Rarer still that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise effective treatment. In this paper, we present design, construction and output Patient Consultation Corpus , multimodal corpus simulated consultations between patient portrayed by an actor, at least two professionals different expertise. As well as transcribed text from each consultation, also contains audio video where consultation: consists individual tracks participant, allowing clear identification speakers; framings participant—upper-body face—allowing close analysis behaviours gestures. Having presented design corpus, then go on briefly describe how multi-modal nature allows it be analysed several perspectives.